BIOptimus: Pre-training an Optimal Biomedical Language Model with Curriculum Learning for Named Entity Recognition

Using language models (LMs) pre-trained in a self-supervised setting on large corpora and then fine-tuning for a downstream task has helped to deal with the problem of limited label data for supervised learning tasks such as Named Entity Recognition (NER). Recent research in biomedical language processing has offered a number of biomedical LMs pre-trained using different methods and techniques that advance results on many BioNLP tasks, including NER. However, there is still a lack of a comprehensive comparison of pre-training approaches that would work more optimally in the biomedical domain. This paper aims to investigate different pre-training methods, such as pre-training the biomedical LM from scratch and pre-training it in a continued fashion. We compare existing methods with our proposed pre-training method of initializing weights for new tokens by distilling existing weights from the BERT model inside the context where the tokens were found. The method helps to speed up the pre-training stage and improve performance on NER. In addition, we compare how masking rate, corruption strategy, and masking strategies impact the performance of the biomedical LM. Finally, using the insights from our experiments, we introduce a new biomedical LM (BIOptimus), which is pre-trained using Curriculum Learning (CL) and contextualized weight distillation method. Our model sets new states of the art on several biomedical Named Entity Recognition (NER) tasks. We release our code and all pre-trained model

DOES THE BOARD INDEPENDENCE INFLUENCE THE ASSOCIATION BETWEEN RISK DISCLOSURE AND FIRM VALUE? EVIDENCE FROM JORDAN

Purpose of the study: This paper aimed to investigate the influence of risk disclosure on corporate value and investigate whether the effect of risk disclosure on corporate value is moderated by the level of independence of boards of directors. Methodology: Using an analysis of annual reports, the study depended on a set of balanced panel data derived from 13 banks listed on the “Amman Stock Exchange” (ASE) from 2014 to 2018. Main Findings: The empirical results indicated that the association between risk disclosure and the corporate value was significant but negative. To examine the influence of the moderating variable, hierarchical regression models were used. The results regarding the moderating effect indicate that board independence (BI) positively moderated the association between risk disclosure and corporate value. Applications of this study: The findings of this article can provide insights into the association between risk disclosure and corporate value and the moderating influence of the board of directors' independence on this relationship. Novelty/Originality of this study: This study is particularly beneficial for understanding the importance of risk disclosure between the management and stakeholders as well as understanding the importance of the board of director composition in enhancing the influence of risk disclosure on corporate value. Moreover, this is the first study to investigate the moderating effect of board composition (represented by board independence) on the association between risk disclosure and corporate value

Effect of pollination time, the hour of daytime, pollen storage temperature and duration on pollen viability, germinability, and fruit set of date palm (Phoenix dactylifera L.) cv "Deglet Nour"

Success artificial pollination with viable pollen is crucial process in the production chain of date palms. This study evaluated the impact of pollen storage temperature and duration, pollination time following spathe cracking, and the hour of daytime on pollen viability, germinability, fruit set and yield of 'Deglet Nour' date palm cultivar. In in vitro tests, fresh pollen showed the maximum viability (96.3%) and germination (85%) but it decreased thereafter upon the storage temperature (28, 4 and-30 degrees C) and duration (3, 6, 9 and 12 months). In this respect, pollen stored at-30 degrees C retained highest viability and germinability followed by those stored at 4 and then at 28 degrees C. In filed experiments, fruit set was 85, 75, 65, and 45% with pollination using fresh pollen, or pollen stored at-30, 4 and 28 degrees C, respectively. Fruit set was 95%, 75%, and less than 50%, for pollination performed on the same day of spathe cracking, 6 and 12 days later, respectively. The highest fruit set percentage and yield/bunch were obtained with pollination performed between 12.0 pm and 15.0 pm in contrast to 8.0-11.0 am or 16.0-17.0. (c) 2021 The Author(s). Published by Elsevier B.V. on behalf of King Saud University. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/)

Formalization of BPMN Gateways using the DD-LOTOS Formal Language

Business Process Model and Notation (BPMN), is a standardized graphical language used for the graphical modeling of business processes. A BPMN model is composed of several small graphs called elements; these elements make it possible to describe the activities, the events, and the interactions between the components of a business process. Among the essential elements of BPMN are gateways, which control the flow of data. However, the big challenge of these gateways is the existence of several interpretations of the same BPMN model containing gateways; this is due to the informal and ambiguous definition. Several works have proposed the formalization of gateways using formal languages such as process algebras, Petri nets, etc. The purpose of this article is to propose a formalization of BPMN gateways using the formal language DD-LOTOS. DDLOTOS is defined on a semantics of true parallelism called maximality semantics and allows to support distribution and temporal constraints. We then propose the verification of certain properties using the UPPAAL model checker. Our approach has been validated through a case study representing the online purchasing process

Board of Directors’ Effectiveness and Firm Performance: Evidence from Jordan

This paper aims to examine the relationship between the board of director’s effectiveness and firm performance in Jordanian listed firms. The study used panel data approach over a period of five years from 2009 to 2013, with a sample of 120 non-financial firms listed on Amman Stock Exchange, these firms represents around 56% of Jordanian listed firms. In terms of the effect of board of directors on firm performance, five characteristics of the board of directors are identified: board of directors’ independence, board size, board meetings, leadership structure and board of directors' ownership. The firm performance was assessed by (ROA) as an accounting-based performance measure and Tobin’s Q (TQ) as a market-based indicator. The findings indicate that the independence of board of directors and board of directors' ownership have a positive impact on firm performance. The results also find that the smaller board size enhances the firm performance. Further analysis shows that the findings fail to reveal any significant impact for the frequency of board meetings and leadership structure on firm performance. The study contributes to the literature on board of directors’ effectiveness and firm performance in developing countries especially in Jordan. This study provides useful information that is of great value to policy makers, academics and other stakeholders. Keywords: Corporate governance, board of directors’ effectiveness, firm performance, Jordan

Assessment of Antibody Titer to Pneumococcal Vaccine in Nephrotic Syndrome Children post Vaccination

Background: The most common glomerular condition in children is idiopathic nephrotic syndrome (INS). Pneumococcal infections are one of the most serious consequences for children with nephrotic syndrome. Objective: Assessment of antibody titer in children with renal impairment 1- and 3-months after immunization with pneumococcal conjugate vaccine 13 (PCV13). Patients and Methods: Cross-sectional research including 24 nephrotic children was carried out at Pediatric Nephrology Unit and Outpatient Nephrology Clinics of Children Hospital at Zagazig University over a period of one year from April 2020 to March 2021. Results: At 1- and 3-months following vaccination, level of antibody titer was significantly higher among patients within group II. There was statistically significant difference between the studied groups regarding trend of antibody at three months. Steroid dosage at time of immunization was strongly associated with antibody titer one month (M) after vaccination in both groups. While there was statistically significant negative correlation between steroid dose at time and 3 months after vaccination with antibody titer at 3 months post vaccination in both groups. Conclusion: Nephrotic children in both groups can mount adequate antibody production to pneumococcal vaccine post vaccination, which is equal or higher than 0.35 μg/ml. On low doses of oral steroids and immunosuppressive medications, PCV-infected nephrotic youngsters developed strong protective antibody titers

Evolution of second trimester low implanted placenta to previa at term: a prospective cohort study

Background: The objective of this study is to identify the percentage of low implanted placenta (LIP) at second trimester of pregnancy and identify the risk factors of its persistence to placenta previa (PP) at term.Methods: Through a registered prospective cohort study conducted at tertiary hospital in Upper Egypt, authors screened all pregnant ladies comes to present facility for antenatal second trimester USG between 18-24 weeks gestation. All participants interviewed for detailed risk factors of placenta previa. Those diagnosed to have a LIP (≤1.5 cm from the internal os) had had TVS to confirm the exact distance between the lower edge of the placenta and the internal os. Serial USG had been done every 4 weeks up to delivery to measure the same distance. The primary outcome was the percentage of LIP at 18-24 weeks. Logistic regression analysis was performed to predict the risk factors for PP at term.Results: Through screening of 1000 pregnant lady, LIP had been identified in (52 cases) 5.2% of pregnant women between 18-24 weeks. This percentage dropped gradually to reach 1.3% at 36 weeks of gestation and at time of delivery. The logistic regression analysis demonstrated that the distance between the internal os and the lower edge of the placenta between 18-24 weeks was the single significant variable associated with PP at term (p<0.001, odds ratio 0.319, 95% CI 0.20-0.50). However, excluding the distance from the regression model demonstrated other risk factors as previous miscarriage, previous cesarean section (CS), and history of multiple pregnancies and history of previous PP.Conclusions: About 5.0% of pregnant women have LIP at the second trimester of pregnancy (18-24 weeks) and only 25.0 % of them remain placenta previa at term. A cut-off value of 10 mm between the internal os and the lower edge of the placenta is the most important predictor of development of PP

Intravenous fluids in hot pre-hospital environments: Thermal and physical stability of normal saline after exposure to simulated stress conditions

Background: Normal saline 0.9 % (NS) is the most widespread crystalloid used as a life-saving intravenous (IV) fluid. 1 NS contains sodium and chloride in equal concentrations and is subject to thermal stress conditions while stored and transported by clinicians in the pre-hospital environment. 2 This study aimed to investigate the effect of high-temperature exposure on NS bags used by the Hamad Medical Corporation Ambulance Service in Qatar. Methods: Five-hundred mL polyolefin NS soft bags (Qatar-Pharma, BN:1929013008) were divided into 4 groups of 24 each and stored at constant temperature (22, 50, or 70°C), or subjected to a temperature of 70°C for 8 hours followed by 22°C for 16 hours repeatedly over 28 days. Inspection and chromatographic analysis of the bags was performed at 0, 12, 24, 48, and 72 hours in the 72-hour study, and at 1, 2, 3, and 4 weeks in the 28-day study. Results: NS bags slightly bulged at 50°C and significantly bulged at 70°C or in the long experiment with temperature variation (Figure 1). During the exposure period, there was no discoloration, turbidity, or leaching of plastic components observed in the NS fluid. The pH readings were 5.59 ± 0.08 (22°C-Control sample), 5.73 ± 0.04 (50°C), 5.86 ± 0.02 (70°C), and 5.79 ± 0.03 following prolonged temperature variation. The sodium and chloride levels for the short-term study ranged from 100.2 ± 0.26% to 107.9 ± 0.75% and from 99.04 ± 0.76 to 102.11 ± 1.71%, and for the long-term study they ranged from 101.93 ± 0.90% to 111.27 ± 2.61 and from 99.05 ± 0.94% to 110.95 ± 1.63%; respectively (Figure 2) in comparison to manufacturer stated concentrations. Conclusion: There was no evidence to suggest that the NS fluid inside the PO bags is physically and chemically different when exposed up to 28 days to 50°C, 70°C, and prolonged temperature variations compared to 22°C. These simulated conditions are subject to further testing under real-life pre-hospital care emergency conditions in a hot country

Burden of musculoskeletal disorders in the Eastern Mediterranean Region, 1990–2013: findings from the Global Burden of Disease Study 2013

Moradi-Lakeh M, Forouzanfar MH, Vollset SE, et al. Burden of musculoskeletal disorders in the Eastern Mediterranean Region, 1990–2013: findings from the Global Burden of Disease Study 2013. Annals of the Rheumatic Diseases. 2017;76(8):annrheumdis-2016-210146